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iNTRnnunTiON » 

' The South Carolina Eciucntion Fintincr Act of 1977 cuntiiins > snvorfll 
implications for schools and school district?,, Aninnn those arR 
iiii(5licat ions' for the gathering and disseiiiiriaLion of ttnt data. The rc- 
sponslbnity for gathering the test data helonos to the State nepartment of 
education. The Act requires that, these data he gathered as part 9f the De- 
paV^tnent's Statuvndc Jesting Program and that each districi nusi partici- 
pate Hn this progranu ^ ^ . 

The rnsponslhil Uy for thff dissejninatinn.of the test resnUs hclongs to 
each schotfl district. As the law specificany states, "tnch school dis- 
trict shall annually submit to Che State Hnani bf rducation and to the peo- 
pie of the district that disCrictU proyraimrat ic rei^ort including results 
of the required testing nrograitu the annual Inng-range plan and the evalua- 
tion of proyraiii .effect iverioss by Aujiust fifteenth nf ench year**' (Act m 
of 1977, Section C-(i-f). 

Kecause the dissemination nf tes\ j-esulrs is new for many districts, 
guidance concerning this dlssenination may be needoH, The purpose of this 
hdndbook is to provide district personnel with infonnation that can he used 
to better coimminicate th^ results of the testing prograni to the people of 
the district. In order to accon^plish (his pirpnse effectively and ef- 
nclEntly", the handbook is oryani^zed into two general sections. The first 
section, "Questions to Anticii^ate and Answers to PrepareV poses several 
questions which school personnel may be asked by the news fnedid, parents* 
and the yeneraT 'puhl ic: This section also presents information wltichwill 
assist school personnel in answering these questions. The questions and 
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answers tiual wHh issiL spociric. In U., aiiiina^sn^ ill JidJii 

SM1U. Form S (CTBS/S) . The CTPMI ■"■« <■•'" '"'■''^"^'y 
J^ate nopartmont of EduMlio;i as P^irt nf l,h. Sintnviid,- To,t in>, Pro„rai".. Th« 
/second section. "»M Procod^rns for R.l.a.UH) T.sl IM.a". prn,nn,. 
1nfon„fll1on concerning U,e prusnntaUon ^,nd r.lna... nf f.M. r..u,,:. fr, IMu 
news nfedia, paronW, and thp uenfirnl pntiHc, 

This handbook was' dcvuTT,p«d in ord.r U, fad 1 i l ^.wunicat inn nf t.hn 
.r^^ulls nbUi,^d irn,H rm.un-.d S-aH-wui. 1,-s, n,„. Hnv„.vnr. fhn 

'suggrstions on iho rrysor,tal ion and rel.a.n nf tns, .cnrn. arP nqu.ll> np^ 
plicablfi u/infon.Jrio„ yaft,ercd frn. nUur d,.! n:.vnd.. u»,Yroyrams ; 
informat ion thai .ay bn sabj.cf m , .n.!^- i f n , rnv,.lnn, n. . b.- 

, rrofulom of infornialion AcU 
■ ». 

; AS indicated in Ihc "Tosl fnordi natnrli u^bv^:' (W^), £SB' 

■ „,c;,ensive Tests of Siill '^-^ 

tent 10 which individual smdnnt. > .vn dn«lop.d t hr capahnilies and 
loai^ed'thc skills thai are prPreqnisi.o lo sluriyiny <md learning in sub= 

■ ject nnto-^ourses. and necessary for func, io.im,- in a society based nn 
, daily use of 1 ing^age' and ^number" (p. 45). Tbns. Ibe n£5 wer.- dnsigneri to 

. gather information concerni r^Hhe extent to which students had .cguired 
general skills (and specifically, general co«unK.lion skills) which would 
benefit them in a wide variety of schbol and non^school sit^uAtions. This 
•focus on measuring liarning whTch results frnn, a wide range of e.perien<ies 
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Is best stated by the devcilopnrs of Lho um "Tho m^^uromnl of thost?. 
skills and abilities cannot bi) divorcnd pntirtny frnmjho monsurrmnrit of 
knowledqe ncquirud throucjb schaolinq, blil_JJ^jj^JHlL,.U^ il^ jll^ 
fh m0aHufe t his knnwlfidnn dlrrctly ^^ {v. 13),, Ibp hnmlbok con^ 
tinues, "thu emphasis In this sorlps [of tests] is on 1 he inrasureirent nf 
the ^asp of broad concepts and ahstr^rtions a^ dovrlDiiod by all 
currictJlums, and on facility in the ^Mlls that are riM;uinMi in the 
effective uso of ianf]uage ^nd mwvbv.r such as c 1 .iss i fy i ny , rnnn i pnl at i nc] , and 
interpret ifUi" (p, 13). ' = 

What T ype of Tusts Are Ihv CTI^S ? 

The CTt'^ are classifiod as "nnnii-rfdrrnnrpd ^ns^^." fnnti^f oforrnrml 

) ^ 

tests provide v;hat may ho teiwd ^^cnnpura t i i rfnrrai i ofi". That is to 
say, students' scores on suci' 'nsU arp ^^iven ,*rarnfu; hy ^cninpdrinu them 
with the scores of a larne, national scirplu of students.- The national 
sample of students must^he at the sume .nh' Uvel css the distria students 
but may differ in terms of ^uch chornctiMMM ics as sncio^econnmic status. 
Thus, the test results from nnrm-referencpd tests indicate ^ow the fjoneral 
skills possessed by students vnthin'a qivi^n schnnl or district cnmpare vnth 
those 4p5sessed by a nationdl sai^fHo nf siuHori^s. 

What Do the CTES Tesf f ' 

There are seven levels o'f tiie viiich are dri^ropr i ale for students^ 

of different ages and enrolled in different trades/ Table I indicates the 
ttiSt levels that are appropriate for studtMits at dtffMretit .}rdde levels. 
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T I K 1 11 \ 


CorreSponcionce nf 


TusL LpvoU vHt.h CriUlt* l.nvnU 


Test Lovel 




A 


■ Pnqinnincj of Ki ncipruiirt.pn to lU'ylnninn 
of fi f 51 CftUln 




Mifl-Kind(?r(]arirri to Incl of MrsL Gr«Kin 


C 
1 


Kid-IMrst Grjuln [m\ of Spcnful nrcirln 
KicUSnccinti Grode to rnd of rourth nrado 


n 

3 


Kid-rourth rrado to Und of Sixth drmiu 
Mid-Si^th Crnde to l;nd of nqhth nrmlo 


4 


Mid-f;ir]hth Hrddo to Hnd of Twelfth Crarin 



The Statewide Testinn Prorjr^ni tpsts siudnnts^at nrade^ 3, fi, and U 
and uses four tnst JevcU: Level Uvrl U Lrvol 2, and Level 4, Levels 
t and 1 are administered at Grade 3, LeveH 1 and 2 are administered at 
Qrade 6, and Level 4 is adnilnistered at firade 11. The composition of 
these four levels Is very similar. Lachfcel (except Lovel C) consists of 
six general skll 1 areas i readinr], lanuuat;e, mathematics, reference sknis, 
science, and social studies, level C does not include a test of reference 

skills, ^ . 

Three of the general skill areas, reading, language, and mathematics 
are divided into'^ subskill areas . Reading is Hiivided into two subskill 
vocabulary and comprehension. Language Is divided into three sub- 



areas : 
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skill , areas- spening, language mechanics, and language expn:3s1on* 
Mathimatics ii divided Into two .subsklll areai: computation and con- 
cepts/applications. Finally, each general Bklll area Is divided into what 
are^cal led content categories . The relationship among general skill arftas, 
iubskin areas, and content categories is shown graphicany 1n Figure U 
The specific relationships for reading, language, mathematics, reference 
skills, science, and social studies are shown graphically in Figures 2 
through ?• 

Typicany7 Student scores are reported for each general skill area, 

although the reporting of scores by subsklll areas or by content category 

is possible. Student scores are initially computed by adding up the number 

of items in. the general skill areas answered correctly 'by each student. 

The number of iterii testing each of the six general skill areas on each 

level of the tests are displayid in Table Z, The time necessary for the 

adrniniitratlon of each set of items is also presented In Table 2. 

Does What Is Heasured by the CTBS Match What Is Taught 
1n the school jsOTTstriet? ^ 

In addTtTon to the organization of the tests and the number of items on 
the tests, the technical quality of the test should ^also be considered. 
One Indicator of a testes technical quality Is validity. 

Validity refers to the extent to which the test measures the sknis and 
abilities that are deaned Important by the school or district. As such, 
validity can be examined by comparing the skills and abilities which. under-, 
lie the test with the skills and abilities which make up^the school's or 
district's curriculum or are contained In the goals of the school or. 



Table 2 

Gtntral Skill Afeas* Nunfeer of I term par Area, and Administration Times 
for Test Levels C, 1, 2, and 4 



General Skill 
Area 


Level 


C 


Level 


1 


Level^ 


r 


Level 4 


1 of Items 


T1me(min, ) 


# of Items 


TimeCmin. )^ 


# of Items . 


Time(m1n. ) 


# of Items 


Tlnie(mlnp) 


Reading 




.56 


35 


50 


85 


49 


85 


46 


Language 


79 


55 


94 


48 


105 


49 


85 


49^ 


Mathernati cs 


53 


59 


98 


75 


90 


75 


98 


70 


Reference 
Ski lis 






20 


^ 15 


20 


. 10 


20 


10 


Science 


30 


35 ■ 


37 


40 


36 


40 


4Q 


40 


Social Studies 


30 


35 


37' 


40 


37 


40 


39 


40 
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diitfict. Since the curriculuni and goals of schools or districts may vary, 
each school or district should examine the validity of the test for that 
school or districtp 

This exanination is best made at the content category level of 'the 
tests. The content categories have been mentioned in Figures 2 through 7 
and are described in greater detail in the Test Coordinator' s Ha ndbooH on 
Pages 33 - 58. A panel of teachers should examine the content categories 
underlying the tests at each grade level. For each content category, con- 
sensus should be reached concerning v/hether that content category is taught 
at that particular grade level. 

The vaHdity of the tests can be reported in tenns of the percent of 
the content categories on the test which are included In the curriculum at 
each grade level. For examf)lc, the language area is conifioscd of eight con- 
tent categories. If five of the eight categories are included In the sixth 
tirade lijnguage arts curriculiJM!^ the validity of the test can he said to bo 
&/8ths or 62 1/2 percent. The higher this figure is, the more valid the 
test Is with respect to the xurr Icul tiru If this figiire falls much below SO 
percent, one should question the applicability or validity of the test for 
the curriculunu Consequently, the. meaning of the test results in terms of 
students' learning of the curriculum Is unclear in this instance. 

Hqm Accurate Are the CTR5 Scores ? 

In addition to validity, a second technical characteristic which shoul.d 
be considered Is reliability. Rel iahil ity is concerned with the amount of 
error that Is present when one describes a person's performance on a test- 



Ti5t5 are not Infallihle. Since .tusts are nnt rf^rfeCt indicators of 
students^ learnino, iom error ^ ts J nevi tabU. Many test users, howfiver, 
.^^.^_^j^^^^^p_^ly^_unmLilMI considpratinn. In t^stinn 

terminolony, this ^crror is represented hy the standard ^^rr^-^ of"^ 
measurnment. Put simply, tt-c standard error of nieasureu'ent can he thonnht 
of as the average ati;ount of error In a student's scorp. Fnr e- "'nle, the 
averane ainoiint'of error on the test of rendinn ii^ n Uein^. "This is to say, 
if the student were to tate the readinc] test on two separate occasions, the 
student's score nifiht differ by as j.m.ch as A Items. Measurement 
specialists take this error into consideration by suhtractinq it from and 
bidding it to a student's score. Jhi^, a student who answers 70 items 
correctly on the readinn test v/nulri likely have a true reading score 
somewhere between (70 ^ ^ items) ^nd 7. f/n . 4 iteirs), Thus, the 
Standard -error of nieasurement is impnrtant in order to understand the 
precision that can he attrihuted to ,^ tpsf score. _ 

The developers of the^CTT^ hc've coiMputec! the standard error of jneasure^ 
rent for each test at each level, The st andnr^^ errors nf measurement are 
presented In Table 3. , 

As can be seen ^n Table 2, l.^ rnnrs ranqe frmi ? Uens to ^ iten^s and 
■ are highly consistent ovsr all four Ipvf-ls nf.l.he tPSts used in the Stati- 
witJe TfStinn rrmjraiii. , If this prrm- is clividod hy t ho mmber of ittms 
which mfiasure a given qenfiral skill area], the percnnt. nf orrof -on Pach tsst 
can hfi corputid/- When this is dnnp:- t.L "n^ost clPrrndahlp" tests {n.n., 
Level 1, matheii.atics) hivp errors of aiWox in>atel7 « percent while the 
' "leaAt dependahle" nests {e.(i., tevel A, bfpr«nCP sHlli.) have errors of 
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Table 3 



ApproKlniate Standard Errors of Measurement for Each Test by Test Level 
(in itnnis and percent error) 









— 1 




1 






Genoral SkiVl^^ - 


^ = - Level C — 


.. . Level 1 


Level 2 


Level 4 


Area 




















^ of Items 


% Errdr 


* of IteFTiS 


■^i Error' 


P of Items 


% Error 


# of Items 


% Error 


Reading 


if 

3 


4": 


4 • 


5';. 


4 


5'^ 


4 




Language 


3 


^% 


4 




4 ' 


41 


' 4 




Mathematics 




^ m ' 


4 




4 


41 


4 


4i 


Reference Skllli 






2 




2 


10% 


2 


10% 


Science, 


2 


7% 


3 


8^ 


3 


B% 


3 


m 


Social Studies 


2 


7% 


3 




3 


B% 


3 


B% 










I- 
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approj(1niatRly ID pprcent, Jhesc Rrrors must be taken into considGration In 
order to make accurrate interpretations of student performance on the tests* 
Since' this is the case, .more wll;! be said about the relationship of 
^standard error of measurenient to test Interpreiation later in this hand- 
book, ' 

Vihat S.tudent Characteristics Should F'e Considered V'hen 
Makiny CompjariMns to^ <hej^j|atJ.£naT SanipTp ?" 

Student responses to the C TPS '"test iteifis are scored as correct or 
incorrect. The sum total of all correct resi^onses made, for each reneral 
skill area test is referred to as the rav^ score . Thus, if tdna answers B2 
out of 04 iten^S correctly on the languaye test, Tdna's raw score is 
Since little is known about ttie difficulty or complexity of the test items, 
raw scores have little meaniny. rrrtainly ?n correct on an easy 3P-i ten! 
test Is not the same as 20 correct on a difficult SP-item test. 

For. results on tests like the CTBS to be meaninnful, the perfonnance of 
a student or a group of students must be related to some known reference 
group.' TheAmost frequently used reference ijraup is a fiational sample of 
students who -are in .the sairin grade as the . students of jnterest. This 
rgfprence group often is called a nn rn^ative sampl e and tests like the CTRS 
-Often- are termed norm-referenced tests . 

In order to make a proper i rtterpretat i on of a school's or district's 
performance, one must first compare the normative sample with the school or 
district samp^le on certain ■relevaMt characteristics, Fxamf5ies oT such 
gharacteristics might inclfide age, srm. ethnic group membership^ and social 
class* If the normative sample and the school or district sampl e 'are .very 
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dissimnar with respect to these characteristics, then cofflpBrisons of the 
test perforniancts of thisi two simples are not very meaningful. 

Wh> are such eon^pirisons not very niianinnful? Consider an example, 
suppose the national sample of third grade studints contains 50 percent 
boys and 50 percent girls. Furthennore, suppose a pirtlciilar district (for 
example. District #90) has 70 percent boys and 30 percent Qirls in its 
third grade. Becausi of the relatively large difference between the 
■proportions of boys in the nomative sample and in the district sample, the 
test results may he expected to he different for the two samples regardless 
o f the quamv 0^ education in that particular district . Furthermore, he- 
cause prior research suggests that third grade girls tend to read "better" 
than third grade boys, the direction of the difference in lest performances 
can be estinatid. We would expect the students in the national sample to 
score higher than the students in District #90 since there is a greater 
proportion Of girls ("good -waders") in the national sample than there Is 
in the district sample. 

Notice that this difference does not reflect on the quality of the 
education given to the srtidents in District M?. Rather, this difference 
mirrors the difference In the composition of the district sample and the 
national sample on a relevant characteristic, namely", sex tif a student. In 
sum, then, schools or districts , that differ greatly in sex, social class, 
and/or racial composition from the national sample also can be expected to 
:d1fi'er' lri test performance from the nationar sampl e. ' The direction of the 
difference depends on what we tnow from previous research. 

Therefore, for proper interpretation of LpsI scores, a comparisnn of 
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the schoal or district sample Vnth that of the" national sample on Important 
charactaristics is necessary. This is best accomplished-, by ■ first cle- 
scriblny t!ie school or district in tenns of such chtiracttirUUcs as the 
(i) proportion of male students, (2) proportion of Caucasian sti'dents, and 
(3) the proportion of students whose parents hold professional or white 
cfrllar jobSp The national sample used for standardizing the CTBS also san 
he described in tertiis of these characteristics. A descriptiori of the 
national sample in terms of these and/Other relevant characteristics can he 
found on Pages 7 and S of the Technical PuUetin No._U 

To the extent that "marked differences" exist bncween the- students in 
the district and the students in the national sasui^f on ti'ese uescriptors, 
a comparison of the ;-^1ative achievement of ihrSH two samples is 
potentially meaningless and should be i^^aJo vn ^h f.^!.:t i:;n. As has been 
suggested earlier, if the '.mv\^^ "^ery d if ^Hront", then any 

differences In the test perfoni^.^f-ce my b^' dttributeH M5 differences in the 
characteristics of students attenciinn tha school or district rather than to 
differences in the quality of educaMon pruvided by the district, schools, 
and teachers. 

In the previous- paragraph pliraso- Mhe "n^arked differences^' and "very 
different'^have been used. 'A question that might be asked is. "How laf^e 
does this difference have to be^ in order to be a 'marked difference'?". 
This is a'difficult question to answer. Certainly, a difference of 2 or 3 
percent is ^not large enough. On the other hand, the difference does not 
have.to'reach 20 percent before the difference is worth noting.^ As a rule 
of thumb, differences of approximately 0 to in percent^ should be considered 
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wi^rth noting. 

. What Scores Are Appropriate for Reporting the Results ? 

For the retnainder of this disctjssion, let us suppose that the r.tudents 
In the di strict sampl e and the students in the national sample are quite 
similar with respect to the aforeffient i nne^l descriptors* Hov/ would the com- 
parison of test results be n?ade? 

By far the easiest and most eas i ly . understood comparison Is given by 
the percentile rank. The percentile rank indicates the [percent of students 
In thp national sample wtiose test performance is equalled nr surpassed by a 
particular student or group Of students in the district sample* For ex- 
amplej if Alfred's test performance is equivalent to a percentile rank of 
59, this number indicates that his test performance was as hinh or higher 
than 59 percent of the students m the national sample. 

Because of measurement error in the test, a rancje of "lively" test 

perfonnancD would he more apf^ropriate than a single nui-iber. Thus, if one. 

s 

standard error" of measurement were tiiken into cons irierat i on, Alfred's test 
performafice coT^ld be said to have equalled or surpassed the test 
performance of sbriewliere hetv/een ^fi nnd perceMr nf ihp *\tu<1ents in the 
national sample* The initial reaction lo such a fipruM^dl 1 nterprtsj at i on af 
Alfred's performance on the test finyht be one of aM'tijement given^ many, 
people's belief in the accurucy of test results, .Such an 1 nt nrfi.retat ion, 
however, is the'^best that Ctvn be liuuif'^ given the fiillibiVity of the test* 

Percentile ranks can be used to" make interijret ations nf schoolwide or 
districtwide test performance in addition to i nterpret at i 6ns uf individual 
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stiidenl Performance. The simrlest way uf inaVinn in appropriate Inter, 
pritation il.to Iriantlfy the top sturient. moit nearly averane student . and 
the hottnin stuc^ent at each grade level in the school or district. The top 
student would he the one having the Kighest total battery score. (The 
tot<.l battery score is based on the student's performance on the reading, 
language, and mathematics tests.) The most nearly average student would he 
the one v/hose total battery score is higher than nne-holf of the students 
TTthTschocl or district and lower than one-half of the stiidpnts in the 
school .or district. The bottom student would be the one whose total bat- 
l«ry score is lower than all other students In the school or district. 
Given those three . students, a simple sumqary figure can be constructed by 
graphiny the percentile rank for each student on each general sMll area. 
An uxamplc of such a figure is displ.iyed in riciure H. 

Figure f shows at a glance how the lop student in the school or 
district compares with the top student in the national sample. Similar 
comparisons- are evident for the <Middle student and the bottom student. 
■ Sum,i,ary statements can he i-ade Uirectiy frw, the figure, for example, the 
figure indicates that our average students "do as well as" the nverage 
student in the nation In the areas of reading and science; the average 
Students "do somewhat better than" the average student in the nation in the 
areas-Qf matha.i^tics and . social studies; and they "do somewhat poorer than" 
thpaCcragc' student In the nation in the areas of language and reference 

, skills.' , ■ 

in order to provide more e.act informat i on , ' the standard error of 
. me«surei,icnt can be indicated on the figure by short vertical lines. T.-ese 
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sliort vertical lines or bands can be copied directly froni the individual 
Student Record which is provided to the school or district by the State 
,nepartment of Education, An example of a summary figure complete wifh 
standard' error bands Is shown In Figtire 9, As can be seen in Fiyure 9, the 
average student in the school or -district 1S| in fact, lower In^the area if 
language but is not reliably lower in the area of reference skills. 

Although this graphical display Is probably the sinifilest method of dis- 
playing the data, the graph does have one drawback. The graphical display 
falls to take into consideration all of the students in a particular grade 
in the school or district. In order to display the petforniance of all 
students i a second type of figure, which can provide supplementary 
infonnatlon to the first type of display Is preferable. The rationale and 
means for constructing this display foilow% 

Suppose the national sample were divided ^i^nto four equal groups on the 
basis of total battery score. Further, s^jppose that these groups are 
called "quarters" (since there are four of thein). If this were done, the 
top qijarter (Q4) would Include students with percentile ranks from 76 to 
99, The upper middle quarter (Q3) would include students with percentile 
ranks froni ST to 75, The lower middle quarter (Q2) would include students 
with percentile ranks from 26 to 50, and the lowest quarter (01) would 
include students with percentile ranks from 1 to Zti, 

Kow, by definitioni one-fourth or 25 percent of the national, sample 
would fall Into each of these quarters, ThuSj a comparison of a schoors 
or district's performance with the perfor^ianct? of the national sample'^can 
be made by computing the number and percent of students in the school or 
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district that fall 1n,o each of the four quarters. Since ^the School 
Prequincy Distribution computer printout is distributed to each school and , 
the District .Freqwency Distribution computer printout is flisiHhuted to 
each district, the percentages in each quarter of the national score 
distribution can be taken directly fron, the frequency distribution report. 

Onci the percent of students at each grade level in the school or 
district who fall into each quarter is dete^ined. the results can be 
■suni^arized in a graphical for. similar to that shown In Fly.,, in. Again, 
a glance at the figure provides useful infon.«tion. For example, the top 

■ students in the district (that is. thos. in the top quarter) "do so.awhat 
better" in reading than their national counterparts. And. the bottom 
students in the district (that is. those ,n the lowest .uart.r) "do more 
poorly" in reading than their national counterparts. The other students In 
the district "do just about as well" as their national counterparts. In 
addition, by adding up the percent of students In the two upper quarters of 
fte national score distribution (that is. QA and q3) , the percent of 

■ students in the district that score above the national average can be 
computed quickly. For" e.a.ple. 55 percent of the students in the 
hypothetical district In -Figure 10 scored above the national average ,n 

reading* - \ 

' Although this second type of display does easily allow tor the 
presentation of the performances of all students, this display does not 
„slly allow for the Jrpsentation of standard errors of measurement. 
Tt,er«fore. in ofder t|- prdyide; a more, complete picture of the test resufts, 
use of., the second UplW m conjunction with the first display is 



recommended. 

Sunmary ' - 

In sum, then, proper interpretation of test results requires a- sound 
uederstanding of "thf validity and reliability of th^ test and the composl- 
^tion of the national sample of students relative to that of the school or 
district sample. To the extent that (1) the test possesses an adequate 
degree of validity relative to the school or district curricula in the 
general skill areas, (2) the error of nieasurement is reasonable and 
ranimbered, and (|3) the composition of the national sample o.f students Is 
similar to that of the school, or/ district sample, appropriate 
Interpretation can be made* Such interpretations can be made most easily 
when the test results are presented In graphic form. Three such graphic 
forms (Figures. 8, 9, and 10) seem feaiibie, niven the desire to improve 
conimunication with a variety of audiences. 

SUGGESTED PROCtDURES FOR RELEASING TEST DATA 

As the Na*".ional School Public Relations Association (1976) has pointed 
out, "assessment pr^ograms tend to be cQntroversiaV' (p* 9), The major 
reasons for this controversy, the assoclgtion contends^ seem to be^(l) a 
lack of awareness on the part of the diitrict personnel of the different 
' audiencei to whom the information is to be presented and (2) a lack of 
understanding of the moaning of various terms which are crucial for 
understanding test /esults on the part of school personnel and the members 
of various audiences. 
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The purpose of this, SiCtion is to provide suggestions concerning what 
to tell Vh«n andjiow to canmunlcate test results ifi a meaningful fashion to 
the two major audiences, the news media and parents. In order to 
acconip^lsh this purposep this section will begin with a brief descrlptton 
of how to prepare a written 'document for releasing the test data, followed 

%y a discussion of^^nformjng school and district staff of the test results. 
Special .concerns for releasing tests results to the news media and parents 

.win also be voiced. Issues dealing with , ways of following up the release 
of test scores via parent conferences, public meetings, and the like 

^ conclude this handbook* ^ - 

Preparing the Written Document^ . > . 

Test resuns%ijould.be r?l eased at the district level by thG district 
superintendent. To a\d in comnuinicatlon, a wri^tten docuiiient should he 
prepared by .the district test coordinator before discussjng the test re- 
sults with either the news media or the public. . The wrMttpn document 
should contain the Items mentioned In Table 4. • ^ 

J ^ ■ - i 

Informing School and District Staff 

Once the document has . been rfr»pared , 1 1 /shnul d be d.istributid to 
school and district Staff. Atlar ailQwiny a sufficiynl lime for the 
reading of the document by school fml district staff, on inservlee day 
should be schedul-ed In order to' discuss the' test program with schoof and 
district staff. Two major purpnsis should he served hy thp inservlee 
meeting. First, questions raised, by the school and district staff should 
be addressed. Sicflnd, suggestioni for ■ changes fn instructional programs 
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table ^■ 



Items That Should Be total ned in the Written Report Prepared by 
the School District 



1, 'Purppse of the Tests (1n the context of the intiri educational program 
of the school or district) 

2* Brief DesctiiptiQn of the Tests 

3. Glossary of Important Terms: Standard Error of Measurement, Raw Score, 
Nortnative Sample, Percentile Rank, and National Quarters 

A. Brief Description of the School or District in Terms of Relevant De- 
' scriptors (e.g.. Sex, Race, Social Status) 

5, Comparison of the Descriptors, of the School or District with the Pe- 
scriptors of the National Sample 

6. Statement of Similarity ti^ the Two Samples and the Necessity of Having 
" Similar Samples When Comparing Student Test Performance 

V Graphical Representation of the Test Results by Qrade Level and; fty 
Skill Area (The results should he presented by school and hy district) 

8. -Comparison .of this Year's Growth Results with the Results of the Prev^ 

ious Year, Stressing Signs of Growth 

9, Comparison of this Year's Results for the School or nistrictr 



What programs are in operation to correct known weaknesseslN^at 




programs are being considered? 

What programs work in those schools in the district that have high- 
er teW^cores? Can ideas be taken from those schools and used in 



schools v/ithO,ovmr test scores? 
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and curricuU should be mide baiid on the test restilts. Such suggtstions 
cm be Incorporatid into the last section of the aocumcnt, if dpsirahle. 
-TKr-itnpoftanci-of-i nf ormi ng -JchoQ]_AmLJjstHct staff Jas bM 



quite succinctly by the National School Public Rilations Association 
(1976): "Riportirs have been known tn • zero in immndiately on a school 
whose scores wen particularly high or low. The principal or teachers who 
shrug off the interview vnth an 'nh, we're not worried about that Mickey 
Mouse program' will undercut v.tiatever communication efforts are madn hy the 
central office" (p. 48). dnce the dociimeht has henn prepared and school 
and district staff informed, the next step is to inform the news media and 
the parents. 

Informing the Hews Media 

The first step in preparing for the news.media 16 to write a news re-- 
lease. "the focus of thiS' release should he a sunimary of the test results. 
The release should be no more than two double-spaced lefial sjje pages in 
length. An example of a news release is presented in Appendix A. After 
the preparB,tion of the press release, reporters should he called in for a 
conference.'"- The district test coordinator will rrnhahly be responsible for 

.cobrdinating the activities related to the press conference. The purpose 
o"f the , conference with the reporters Is tn explain the information 
presented in the press release and to supplement the verbal statement with 
graphs and tables where appropriate. ^ 

' With respect to both the, release and the conference, use positive 
Statements whenever possible. That is. talk about itrengths first, then 
weaknesses. Mention the percent of students above a certain level, not the 
percent bel ow it.. 
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in preparing this handbook certain terms have been avnided. Terms such 
as grade-equivalent scores and total battery scores should he avoided v/hen 
discussi nci the test results with the nevs media and the public in yeneral , 
-Such=--te-^S--Should-^h_e_jv^gid of the misinterpretation often as- 

iociated with them, "For example, grade equivalent scores fall to take into 
consideration the appropriateness of the content areas for the students*. 
To thinK that a third grade student whose third grade test performance 
indicates that he is "at the 6th grade level" and can, in fact, work 
matheiiiatici problems contained in the 6th grade curriculum is ' Inap- 
propriate. The "6th grade level" only means that he viorks third grade 
mathematics problems e?(tremely well for a third gJ^ade student. Rather than 
eKplain this Important issue to every audience, the .sugqestioh is that, 
^grade^equivalent scores not he presented. 

Finally* the National School Puhlic Pelatinns Assaciation suggests fol- 

lovnng b few basic rules in dealing with the nev^s media. These rules are 

as follows: ■ • 

*nive the media everything you have* Pon't 
hide anything* They'll probably find out 
anyway, and then you'll be in real trouble. 

s 

*non't belittle or downgrade any of the data* 

' / *Prepare charts or tables to hand out, V'ith- 
out distorting the data, you may he able to 
arrange the statistics In a more easily 
understood format, 

*Don't let .the reporters got you on the de- 
fensive* ^ Qnce they do, it's downhill the 
rest of the way, (p. 51) 

At the end of the press conference, inform the media that the district 
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test coordinator has been eharged viUh quickly and accurately responding to 
additional questions and inquiries from .the press and the public. If your 
summary is well, written and the above rules are followed, yonr rolationship 
with the news medTa will likely be positive and productive. 



Informing Farints, 

Informing parents is a continuous activity. Parents should hr Informed 
throughout' the school year of the testino program and the test results. At 
the'beginning of the school year, parents shouid be informnd oj the nature 
and purpose of the testing progranu Then, ahnut one mnnth before the ^ 
^ scheduled administration of the tests, parents should he informed of the 
pending administration. After the tests have been actmini strred , the firsi' 
information that parents recelvn vnll quite likely cosre from their children 
and the press. If the press has been rrorerly informed, the first reaction 
by the parents will likely he positive. Furthermore, If the test results 
are communicated to the students, additional benefits my accrue. As the 
National School Public Relations /Association writes, ^hink how much a 
pareht's mind would be eased if iZ^year^old Jimniy would come home and say, 
'We got our test scores back today and our teacher said we did pretty well 
except in arithmetic so we worked on a lot of problems and J think I under- 
stand it better.* Scratch one worried mother." (p. 54). 

Communicating test results to individual parents should be done in a 
, parent^teacher or parent^guidance counsel or conference. Pefore the. meeting 
with the parents, the Individual Test Record for the child should be re^ 
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trieyed fro?n the child's, pemianent record file, Regin th^ conference by 
explaining the meaninfj of the i^oints and "K's" on the graph Then, discuss 
the child's perfomjance on each test. Again, as in the case of the news 
media, focus first on the strengths of the .child, then on the weaknesses. 
Indicate what the school intends to do about the wpaknessps, as well as 
wli a t Ther' p a rent s can d o . A t ' t h'e e n d o f " t h e c □ n f er e n c e , " s unma r i ie ' wh a t - h a s^-^ 
been said in order to rnininuze iiii sunderstandi ngs on the i^art of the 
parents i 

Providintj Follow-Ups 

The surest way of destroying the effectiveness of "a testinc] program is 
to yiew the program as^ a once-a-year thing, like paylny taxes on April 
15th, This point has been^ alluded to earlier in the discussion about'ways 
of inforining parents* The= testing [Tngran: should he seen and explained a^ 
an integral part of the district's educational program, If this 'is true, 

i 

opi^prtuni ties need to be provided for teachers news media , and parents to 
follow-up the rest/Its of the testiny progran', 

V Suzanne Stenmock (1974) suygests several ideas for follow-ups that are 
vmrtiiy of consideration by district [personnel. * 

Fi.rst , briefings can be provided for niembers nf the news inedia who want 
additional infom.ation. These brief ings could focus on a more detailed 
discussion of various components of the testing, program or on supplementary 
test results. 

Second, print a booklet for widespread distribution-. This booklet 
^ould contJin all press articles and a coniiiientary by the district test 
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coordinator. 

Third, following the release of the test results, a panel of 
administrators may review the tests to identify strennihs and wedknossns of 
students at each grade level tested. This review should focus on the test 
results' by specific content catenory rather thanMsy general sMll areas 
and/Qr subskill areas which are much too global. Thus, questions should be 
raised such as Hov/ did our. third grade students i»erforni in the area of 
syntactical relationships (one of the cnntenl catcgnrios of the language 
test)?r Should we include syntactical relationships in our third grade 
curriculum (since we do not at the present time)?; Shnuld we einphasi^e 
syntactical relationships ^more than we do?; Should we devise a new 
instructionar program to teach students syntactical - relatinnships?. 

Fourth, reading, language, mathcniatics, ruference skills, science, and 
sociaV studies supervisors can visit each srhonl to discuss changes that 
■can be made in hopes af improving student dcHievenentS in the upconHng 
year. As much as ^pnsslble, suggestions for changes should cniiie. from the 
staff -Qf the school ,MiOt' from the snf'ervisor. Teachers tend to reject 
"iiuprovements'' ttiat are siiggrsted hy "nut s iders" , 

HinaVly, according to Stennnck, v.drtstiops can Pe j^rovided for parents. 
The focus of these workshops should be on ways in v;h ich, parents can help ,to 
reinforce . the school's programs in their hoinps,^ Suggestions for home 
activities that likely will aid children's lenrninq cun be n^arie. 

' In general, then, follow-ups" affrr ihv rpleast: of the test results are 
impoi^ant If^l use of the results is to he mnde. The test results 
Should not be viewed as "one^shot deals", having little or no relationship 
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to the educational program of the schools, _ ^ Rather, test results cm% 
provide usoful informat ion" for Improv.in?] the eciucational progranu If this 
Is' to be done, all persons concerned (that iSj parents; tedchers, and 
repc^rters) must be informed of the testing program, the reraiUs of the 
testing program, the 'rel ationship of the testing urogrdrn to the 
instructional prociriam^ and proorams for iniproving the v/edknessu? Identified 
^by.. .the. test- r:esul_ts_p__ Fol low-ups sucfi as those rnentinned by Stenmonh help 
to convince people of the fole of testing in the total educational program 
of the schoQl or district. 
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An rxample of a nistrlct Nev/s Pelpaso 

roR tMMrniATE pflfasf 
(date) 

DISTPlCTViinE 1"EST 

RESULTS mmntiri 

niTY Relative to the nation, third, sixth, and eleventh qrade students 
in District are achieving quite v/ell in school, Surrjiiary resijlts of the 
April testing weTe announced yesterday by Di-strict Superintendent M*T-. 
Jones* 

A' total of 1,215^ pupils in grades, three, f.ix, and eleven was 
administerec! the Comprehensive Tests of piiic SMTU jQPjl ^^^^^ Ifi-IH, 
1979* The CTE5 are rati onal ly ^ standardi zed achievenient tests which as- 
sess student achieveinent in sik general areas: reading, language, 
niathimatics , reference skills, science, and social studies^ 

Jones said that District ^09 students generally performed highest in 
the areas of language, science, social studies, and reference skills, {Re- 
ference skills refer to such abilities as usinty the dictionary and library 
to locate^information.) In all three grades, itiore than AS percent of nis- 
trlct ^99 students scored above the natirnal average in these four areas. 
The, lowest perforniance for all -three grades was 1n inathemat ics . 

■ In the area of language, 4B percent of nistrict #"9 third graHprs 
scored above the national average- 45 percent of the sixth graders scored 
'^above the national average; and 41 percent of the eleventh graders scored 
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M)avr til.o national averaue. 



In ridthnraLics, 4n pnrcrnt of t hn Lhi rH.qrdfir^t Ufirnt^ ^corod abovn the ^ 
naUonnl avrraiin. Thr torcnniaqn^ in «]rac!ps six anr' olnvnn v^rro 33 .nnd 
rrspnct ivply . 

W.v hinhPSt civpracir scorus for Pi^frint H'^^' studpnt^ s/prr in Hir .rrrd 
Of rnfurnncp sMlls. Fifty iwct-nt of thp t.hird iirmiors, ^U^ prt^cnnt of tho 
sixth (jradrfS, flfid ^? yvrcpnt nf rhp pIovptU^ orndp ^tiidpnt^ snnrnd nhnvp ^ 
the natinnal avpr^sue in rrfprpncr sMlU* 

Thp rosiilts in sniRncn .nnd ^nrial ^tudirs v/ptp auitp ^iinil^r. Tp- 
proxirately 47 pp|^pnt of iMp third ormlp nudrn^s ^cnrud dbovo Lhn 
natinnyV as/nrnnp fn thpsn two arpds. f pprQK irmf pW 4:' and prrrmt of 
thp ^ixth and plpvpnfh nradp UnripnU, rpsppcMvpl^^ scorpd abovp thn 
natinnal avnraqp In scinncp and sncial studips. 

At thp rplnasp of . ttip suiiiU'ary rpsult^^ Jnnps unjpd caution in Intpr- 
protinn thn results. ?incr thp studt^nts in thp r^at innal sampln diffpr 
^ cnnsi'derahly from the District ntiidrnts in tprms nf snci o^pronomlc 

Status, racial coMipositlon, and othPr charactpri st ics , thp scores of the 
district sample and thp national samplp arp nkely to hp snmpwhat 
diffprpnt. If OOP vfere to con-parp thp top stiidmts in pistrict /'^r with 
the top stiidpnts in the national sar'plr at pach qradu Ipvpl, for example, 
thp differencPS in test^ perfonrance ^^ould bp nVin^^t. Thp bottom sturipnts 
in District #09, however, tend to score much lower than thp hottom midents 
in the national sample* These hottoi;^ students in thp district tend to come 
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from n-orb culturally deprived homns than their countfirparts In the national, 
sample. 

SincB thB scores were lowest In reatling ami inaihenialics , a panel of 
teachers and adHnistrators has been fomird to Study this problwu Tho 
panel will bflflin by comparing the areas of wphasis nf the test vnlh the 
areas nf emrhasis of the readinn and mathemalics programs used in the dis- 
trict. If areas are found that stKnild he en-phasizpd in the prnqrams but 
currently arc not beina emphasized, changes in the programs will bo con- 
sidered. If chanoes arO proposed, parents will be asked to cemmont on the 
chanfies prior to instituting such chancies. 

Parents Interested in dhtaining additional information about the test 
results are encouraged to contact Mrs. Flora Smith, the District Test 
roordinator'. Mrs. Smith can he reached at 555.1234. 
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Top student 
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Middle student 
in school /district 
Middle student 
in national sample 



Lowest student 
tn school /district 
Lowest student 
- in national sample 



General ^eadlnq Language Mathematics Reference Science Social ^ 
Skill Area ^ " ^ Skills ■ Studies 



Figure 8. A Summary Dnlehool/Oiitrict Performing on the CTBS/S (by Gineral Skill Arsa). 
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Figure 9. A Summary of SchooVDiitrict Performance on the CTBS/S (emphasizing errors of measurement) 
(by Gentral Skill Area). - 
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Figure 10. . Graphical Display of SchooVDI strict Risults on the CTDS/S (by General Skill Araa). 
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